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ABSTRACT 


^  In  this  paper,  the  authors  investigate  Edgeworth  type  expansions  of 
certain  transformations  of  some  statistics  of  Gaussian  ARMA  processes. 
They  also  investigated  transformations  which  will  make  the  second  order 
part  of  the  Edgeworth  expansions  vanish.  Some  numerical  studies  are  made 
and  they  show  that  the  above  transformations  give  better  approximations 
than  the  usual  approximation. 


Key  words:  Edgeworth  expansion,  Fisher's  2  transformation,  Gaussian  ARMA 
process,  maximum  likelihood  estimator,  periodogram,  quasi¬ 
maximum  likelihood  estimator,  spectral  density. 


I 

1 .  INTRODUCTION 

In  the  area  of  multivariate  analysis  several  authors  have  considered 
transformations  of  statistics  which  are  based  upon  functions  of  the  ele¬ 
ments  of  sample  covariance  matrix*  and  derived  the  Edgeworth  expansions 
of  the  transformed  statistics.  Konishi  (1978)  gave  a  transformation  of 
the  sample  correlation  coefficient  which  extinguishes  a  part  of  the  second 
order  terms  of  the  Edgeworth  expansion.  Also,  Konishi  (1981)  discussed 
the  transformations  of  a  statistic  based  upon  the  elements  of  the  sample 
covariance  matrix  which  extinguish  the  second  order  terms  of  the  Edgeworth 
expansions.  Furthermore  Fang  and  Krishnaiah  (1982)  gave  Edgeworth  expan¬ 
sions  certain  functions  of  the  elements  of  noncentral  Wishart  matrix;  they 
also  obtained  analogous  results  for  functions  of  the  elements  of  the  sample 

covariance  matrix  when  the  underlying  distribution  is  a  mixture  of  multivariate 
< 

distributions. 

The  object  of  this  paper  is  to  study  the  accuracy  of  Edgeworth  type 
expansions  of  certain  transformations  of  .some  statistics  which  arise  in 
time  series.  The  results  in  this  paper  are  useful  in  drawing  inference  on  the 

parameters  of  the  spectral  density  when  the  model  is  additive  and  the  ob¬ 
servations  consist  of  the  sum  of  noise  and  signal  components  and  these  «*gnals 
form  ARMA  processess.  A  description  of  the  contents  of  this  paper  is  given  below. 

Let  {X.}  be  a  Gaussian  ARMA  process  with  the  spectral  density  f-(x), 
where  0  is  an  unknown  parameter.  Suppose  that  a  stretch  »  (X.| ,  X.j.)' 

of  {X^}  is  available;  Taniguchi  ((1983),  (1986))  gave  the  Edgeworth  ex- 

A 

pensions  of  the  maximum  likelihood  estimator  and  the  quasi-maximum 

A 

likelihood  estimator  of  9.  Suppose  that  a  function  g(0)  is  smooth 
with  respect  to  9.  Also,  let 

»  vTITiT  {g(9*)  -  g(9)  -  Y}/g'(0) 

^  A  A 

vhere  0#  is  the  9njj^  or  and  1(9)  is  the  Fisher  information,  and  c  is 

a  constant.  Then  we  can  give  the  Edgeworth  expansion  of  Vj  such  as 


1  o 

pI{V,  <  x}  =  »Cx)  -  —  <i>Cx){a,(g'  ,g' '  ,c,e)x‘^ 

9  T  -  ^  I 

+  a2(g'.g".c,9)}  +  OCr'').  (1.1) 

where  $(x)  and  <{i(x)  are  the  standard  normal  distribution  function  and  its 
first  derivative,  respectively.  Then  we  set 

a-jCg'.g"  »c,e)  =  o,  (1.2) 

32(9' *9"  »^»®) 

Solving  the  above  differential  equations  we  can  give  the  normalizing 
transformation  g  and  the  constant  c  which  make 

1  X}  =  4(x)  +  0{T“^).  (1.4) 

Some  interesting  examples  will  be  given.  Suppose  that  {X^}  is  an  ARMA 
(p,q)  process  with  spectral  density 


2  n  (1  -  e^e'Md  -  e.e’''^) 
j=l  J  J 


ii  (1  -  o.e^^)(l  -  a.e  *'') 
j=1  J  ^ 


•1  X  ^ 


(1.5) 


where  a^,...,ap,  Si,...,eq  are  real  numbers  such  that  laj|<l,  j=l . P» 

l6j|<l,  j=l,...,q.  Suppose  that  is  an  unknown  parameter  (i.e.,  0  =  a^^), 
and  that  ,... ,ap,  6i,...,Sq  are  known  parameters.  Then 

A 

for  the  raximum  likelihood  estimator  a|^  ®k  *  differential  equations 

(1 .2)  and  (1.3)  lead  to 


g(ak)  ^  \  log{(l  +  ®k)^(^  "  “k^^* 


(1.6) 


which  is  Fisher's  z-trans formation  and  gives  the  normalizing  transformation, 


aO 

As  for  the  maximum  likelihood  estimators  ('^“^•••••g)  ^nd  of 

2 

6|^(k=l , . . . ,q)  and  o  ,  respectively,  it  will  be  shown  that 
g(eJ  =  8.  (k=l . q)  and  g(a^)  = 


give  the  normalizing  transformations  of  Ck=1,...,q)  and  respec¬ 

tively.  Also,  for  the  quasi-maximum  likelihood  estimators  the  normalizing 
transformations  will  be  given.  In  Section  4,  the  results  of  some  numerical 
studies  will  be  given. 


2.  PRELIMINARIES 


We  introduce  and  spaces  of  functions  on  defined  by 

00 

=  {f:  f(x)  =  I  a(u)expC-iux) ,  a(u)  =  aC-u), 


U=-a 


I  1 ul la(u) I  <  «}, 

U  =  -oo 


?  '  I 

^  I  •_  J 

S  =  rf-  ff ji  =  - _ - 

ARMA 


i  jX,2 


I  5  .  ijx 


I  I  be 
j=o  J 


(a  >  o)}. 


In  this  latter  expression  p  and  q  are  positive  integers,  and  A(z)  = 


q 

r 


L 


J=o 


r  • 

and  B(z)  =  5!  b.z'^  are  both  bounded  away  from  zero  for  |z|  £  1. 
j=o  ^ 


We  make  the  following  assumptions. 


Assumption  1. 
density  fg(x) 
set  of  in' . 


{X^}  is  a  Gaussian  stationary  process  with  the  spectral 
c  ®  ^  0  c  3^^ ,  and  mean  0,  where  G  is  a  compact 


Assumption  2,  The  spectral  density  f„(x)  is  continuously  three  times  di f f 

y 

2  2 

erentiable  with  respect  to  0,  and  the  derivatives  af^/ae,  a  fg/39  and 
a^fg/ae^  belong  to 


Assumption  3. 
measure:. . 


If  0. 


+  then 


f  if  on  a  set  of  positive  Lebesgue 


Assumption  4. 


1(6) 


riT 


'W  ’09  fe(x))2dx 


-ir 


Suppose  that  a  stretch  =  (X,  of  the  series  (X  1  is 


5 


available.  Let  be  the  covariance  matrix  of  Xy.  The  likelihood  function 
based  on  X.p  is  given  by 


L(0)  =  (2T:)''''/^(l:pr^/^exp(-l/2  X|  X.p). 


(2.1) 


We  define  the  maximum  likelihood  estimator  of  6  by  a  value  which  maxi¬ 
mizes  L(9)  with  respect  to  9  e  0.  Now  we  denote 


4  --ff- 


^'“TT  do 


(x)}{fQ(x)}'^dx 


4  ^'jr 


Then,  from  Taniguchi  ((1983),  (1986))  we  have. 


Lemma  2.1  Under  Assumptions  1-4, 

pJ{/nT0T  (e^L  -  9)  1  X}  =  $(x) 

Yi  7  1 

-  Mi—  +  —  (x^  -  1)}  +  0(T’^), 

/T  6/r 


where 


„  _  J(e)  +  k(9)  ^ 

21(9)3/2  »^1 


3J(9)  +  2K(9) 
Tr.^3/2  • 


1  x2 

(|)(x)  = - exp  — and  $(x)  =  (j)(t)dt.  □ 

As  another  estimator  of  9  we  use  the  quasi -maximum  likelihood  esti¬ 
mator  which  maximizes  the  following  quasi-1  ikel ihood 

1  ■T-l 


.VM-'v 


‘O  •v*'  V* 


with  respect  to  0,  where  X.  =  2Trj/T,  and 

J 


‘itx 


J|2 


We  set  down 


b,(x)  \  |n|YCn)e"\ 

n=-oo 

where  Y(n)  =  E.(X  X.  ).  From  Taniguchi  (1983)  we  can  get  the  following 
9  L  L+n 

lemma. 


Lemma  2.2  Under  Assumptions  1-4, 

pJ{/nT9T(0q„L  -  9)  1  x}  =  $(x) 


where 


Ot  *  Y  * 

-  <^(x){—  +  — (x^  -  1)}  +  0(1*''), 
/T  6/T 


B(0)  0(9)  +  K(0) 

7(^--77[^* 


I 


30(9)  +  2K(9) 


7 


3.  NORMALIZING  TRANSFORMATIONS 


A  A 

In  this  section  we  seek  transformations  of  and  9  which  make 

ML  qML 

the  second-order  terms  of  the  Edgeworth  ejcpansions  vanish.  Let  gCe)  be  a 
three  times  continuously  differentiable  function.  Notice  that 


=  /rrX0T{g(0*)  -  gCe)  -  yl/g'Ce) 

=  /mFTlCe*  -  6)g'Ce)  +  ^Ce*  -  9)^g"C9)  -  fl/g'Ce) 

+  higher  order  terms,  (3j) 


A  A  A 

where  9*  is  or  c  is  a  constant.  Then  from  (3,1)  and  Lemmas 

2,1  and  2,2,  it  is  not  difficult  to  show  the  following  theorems  (see 
Taniguchi  (1986)), 


Theorem  1 .  Under  Assumptions  1-4, 

Pq  r/nT9T{g(9„L)  -  g(9)  -  jy/9'  (e)  <  X  i 

=  ,(X)  -  ,(X)  [i-(-  Me.).±  2K(9)  ,  _j^:(9.)  ^ 

6/T  1(9)^/^  g’(9)l(9)^^^ 

/r  eKe)-^'"^  9 


(3.2) 


Corollary  1,  Under  Assumptions  1-4,  if  g^(e)  and  c^  satisfy 


and 


g;'(9)/g;(9) 


3J(9)  +  2K(9) 

— nr?) — 


KC9)g;C9) 

61(9)^ 


(3,3) 


(3,4) 


then 


=  <t(x)  +  o{r'). 


C3.5) 


We  seek  the  function  g^C*)  and  the  constant  c^  which  satisfy  (3.3) 
and  (3.4).  For  ARMA  (p,q)  process  with  the  spectral  density  (1.5),  we 
have 


I(-) 


=  - K(ct  ) 

1  -  a  . 


6a  .  -  Za . 


(1  -  ct^) 


I(3j) 


1  -  B 


J.  K(Sj)  = 


-66 


(1  -  Bj) 


(1  -  .p' 

(j~l»*»»»P) » 
46  . 

fe’  °  t; — :h 


(1  -  B^' 

(j“i»»«»»q)» 


I(a^) 


1  ,  K(a2)  =  J(a^)  =  - 

2a  a  a 


(3.6) 


(see  Taniguchi  (1983)). 

«  *  *2 

“k  ML’  ®k  ML  '^ML  maximum  likelihood  estimators  of  8|^  and 

a^,  respectively. 


Case  l)  If  0  =  1  then 

J  log{(l  +  a.  )/(l  -  a.  )} 


That  is 


^  -  \.HL» 


-  j  log{(l  +  a|^)/(l  -  a^)}  +  - - <  x] 


TO  - 


=  $Cx)  +  OCT'b, 


Case  II)  If  e  =  s,^,  then 


and 


That  is 


9o'6|(>  =  ®k 


‘'o  '  ®k- 


’b'^,  ,  j2  *®k,HL  ■  *k  ■  T*  i  ’‘I 


=  4(x)  +  Od''). 


Case  III)  If  9  =  then 


2^  ,  2,1/3 


and 


ggCo  )  =  {o^} 


'o  =  - 


That  is 


pT  \±  ^  r(n  20/3  I  20/3  ^ 


=  t(x)  +  OCT"^). 


As  for  the  quasi -maxi mum  likelihood  estimators*  we  have  the  following 


theorem  similarly. 


Theorem  2.  Under  Assumptions  1-4, 


pJ[vTIT9T{gC0q„L)  -  9(9)  -  Y>/g'C6)  <  X] 

=  t(x)  -  ♦(x)[4(- 


/T  1(9) 


6I(0)' 


,  _L(.  3J(e)  ^  2K(6)  ^  3g"Ce)  ^2j  . 


g'  (e)i(e) 


(3.10) 


Corol  lary  2.  Under  Assumptions  1-4,  if  g^(9)  and  satisfy 

g-{e)/g;(e)  = 


(3.11) 


Cl  -  -  g  (9)<t(9T  ^TTTm^* 


61(e)' 


(3.12) 


pJ[VTTIe){g^(9q^L)  -  9i(9)  ’  ■Y}/g;(0)  1  x]  =  $(x)  +  Od''').  (3.13) 


By  (3.3)  and  (3.11)  we  can  see  gQ(9)  =  gi(9).  Thus  for  the  quasi¬ 
maximum  likelihood  estimators  the  same  transformations  as  the  maximum  likeli 
hood  estimators  give  the  normalizing  transformation.  Also  we  can  seek  the 
constant  c^  which  satisfies  (3.12).  Since  evaluations  of  B(0)  are  difficult 
for  general  ARMA(p,q)  processes,  we  consider  the  ARMA(1,1)  process  with  the 
spectral  density 


4.  NUMERICAL  COMPARISONS 


In  this  section  we  give  some  numerical  comparisons  related  to  the 

approximation  C3.7)  in  an  autoregressive  process  +  e^,  wher 

2 

are  i.i.d.N(0,a  ).  Let 


=  (1  - 


T-1 
I  XtX 


t+1 


T-1 


It  is  known  (Fujikoshi  and  Ochi  (1984))  that 


P^{/TTT^(a\,,  -  a)  <  x)  -  P^{/nTO(a»«  -  a)  <  x)  =  o{T"^). 
a  NL  —  a  ML  — 


Thus  henceforth  we  use  in  place  of  the  exact  maximum  likelihood 

A 

estimator  Let 


JT) 

r't) 


(a,x) 

(a*x) 


^  2'^ “ml  "  i  » 

V  1  -  a 

pjtild  -  log{(l  +  a„L^/(l  -  a^^)) 


i  log{(l  +  a)/(l  -  a)}  + - 2 - <  x1  -  ♦(x) 

^  T(1  -  ad  - 


and 


M^'’’^(a,x)  = 


iT  r  ,C 


-  ^  log{(l  +  a)/(l  -  a)}  + - }  <  x]  -  $(x) 


T(1  -  ) 


Here  the  probabilities  P  (•)  are  computed  by  5000  trials  simulation. 

We  can  see  that  our  transformations  (even  if  the  normalizing  factor  is 
estimated)  give  better  approximations  than  the  usual  normal  approximation. 
Tables  I,  II  and  III  give  the  values  of  L^^^(a,x),  R^^^(a,x)  and  M^^^(a,x) 
respectively  for  T  =  100,  300,  a  =  -0.90(0.10)0.90  and  x  =  -2. 0(0. 5)2.0. 
From  the  tables,  we  observe  that  the  transformations  proposed  by  us  give 
better  approximations  than  the  usual  normal  approximations  even  if.  the 
normalizing  factor  is  estimated. 


TABLE  III  (continued) 
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